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Abstract 

We present a novel method for the classification and reconstruction of time dependent, 
high-dimensional data using sparse measurements, and apply it to the flow around a cylinder. 
Assuming the data lies near a low dimensional manifold (low-rank dynamics) in space and has 
periodic time dependency with a sparse number of Fourier modes, we employ compressive sens¬ 
ing for accurately classifying the dynamical regime. We further show that we can reconstruct 
the full spatio-temporal behavior with these limited measurements, extending previous results 
of compressive sensing that apply for only a single snapshot of data. The method can be used 
for building improved reduced-order models and designing sampling/measurement strategies 
that leverage time asynchrony. 


1 Introduction 

Data-driven methods, often rooted in new innovations of machine learning [1, 2, 3J, are becoming 
transformative tools in the study of complex dynamical systems |4]. Such methods aim to take 
advantage of the ubiquitous observation across the physical, engineering and biological sciences 
that meaningful input/output of macroscopic variables are encoded in low-dimensional patterns of 
dynamic activity 0 ® mu muni ni]. Reduced-order models (ROMs) capitalize on this observation 
with the goal of producing real-time computational schemes for modeling complex systems (See the 
recent edited monograph addressing the state of the art in reduced order methods for computational 
modeling of complex parametrized systems [12]). Complimenting these efforts are new theoretical 
efforts using sparsity promoting techniques [iMaiisHiiiinniaiiiEn] which exploit this fact in 
order to deal with the practical constraints of a limited number of sensors for data acquisition in the 
complex system no mum mug. Such findings lead us to conjecture that a principled approach 
to sensing in such complex systems will allow us to probe the latent, low-dimensional structure of 
dynamic activity relating to the fundamental quantities of interest. A direct implication of such 
a data-driven modeling strategy is that we can gain traction on prediction, state-estimation and 
control of the complex system. To this end, we demonstrate that asynchronous sparse measurements 
in both time and space allows for a robust method, i.e. a spatio-temporal compressive sensing 
method, for classifying the dynamical behavior of a given system. Once classified, it can be used for 
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full state reconstruction and/or future state prediction of the full spatio-temporal system, extending 
previous works [H1I22 which only reconstructed single time snapshots of the data. 

To demonstrate out methodology, we consider a practical implementation of our technique on 
time-varying fluid flows that are ubiquitous in modern engineering and in the life sciences. Specifi¬ 
cally, we use the asynchronous sparse measurements in time and space on the pressure field around 
a cylinder to classify the Reynolds number and reconstruct the full pressure field. This problem was 
previously and successfully considered nuns with the view of only considering spatial compressive 
sensing. The addition of asynchronous time measurements is the new innovation considered here 
allowing for a more robust architecture for performing the classification task. 

Our method is motivated by bio-inspired engineering design principals (2611271 mi US] whereby 
birds, bats, insects, and fish routinely harness limited measurements of unsteady fluid phenomena 
to improve their propulsive efficiency, maximize thrust and lift, and increase maneuverability (3U1 
I3T113211331 [331 135]. Indeed, despite their limited number of computational resources and spatially 
distributed, noisy sensors, they achieve robust flight dynamics and control despite potentially large 
perturbations in flight conditions (e.g. wind gusts, bodily harm). Such observations suggest the 
existence of low-dimensional structures in the flow-field that are sparsely sampled and which are 
exploited for robust control purposes. 

The primary innovation here revolves around the compressive sensing ideology. Compressed 
sensing allows the reconstruction of a signal using a small number of measurements, based on the 
fact that the signal has a sparse representation in an appropriate basis dam na uni utkihj uni . 
This allows the use of less measurements than the Nyquist-Shannon criterion requires mm • 
Although typical applications are found in areas spanning signal processing to computer vision, our 
objective is to use the methodology for the numerical solution of partial differential equations (PDE) 
and/or direct observations of complex systems. We present a specific example - the incompressible 
Navier-Stokes flow around a cylinder. However, the framework presented can be applied to a much 
broader set of equations. At the method’s core is the fact that most complex systems, including the 
flow around a cylinder, exhibit an underlying low-dimensional structure in their dynamics, such an 
assumption is at the heart of the ROM methodology. Unlike the standard application of compressive 
sensing for image processing, for example, where the sparse (wavelet) basis is already known, the 
optimal sparse basis considered here is computed directly from PDE simulations (e.g. through a 
proper orthogonal decomposition, for instance). Previously, the method was developed to classify 
the Reynolds number for flow around a cylinder given a single snapshot measurement |21| . However, 
by using asynchronous temporal measurements as well, the method can be greatly improved. Thus 
a spatio-temporal version of the compressive sensing architecture is developed and advocated here 
as the primary result. 

The paper is outlined as follows: In Sec. 2 we outline the underlying methods used for the spatio- 
temporal dimensionality reductions, highlighting how low-rank structures in both space and time 
are equally exploited. Section 3 outlines the method used for reconstruction of the solution given 
a sparse set of measurements. Classification of the dynamical regime of the system, which is based 
upon libraries of dynamical modes, is demonstrated in Sec. 4. Sections 2-4 in combination form 
the core innovation of this manuscript, leading to the example problem of flow around a cylinder 
of Sec. 5. A brief conclusion and outlook are given in Sec. 6. 
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2 Dimensionality Reduction for Data Snapshots 

Dimensionality reduction has a long history in regard to theoretical methods applied to complex 
dynamical systems. Before the advent of computers, dimensionality reduction often was achieved 
through asymptotic reductions of the governing equations. Indeed, many well characterized the¬ 
oretical examples of fluid dynamics are due to perturbative reductions of the full system in some 
parameter regime, e.g. the low Reynolds number limit. Such reductions allow for a simplified model 
where known analytic methods can be applied to great effect. These asymptotic techniques also 
serve as the backbone for normal form reductions for characterizing the low-dimensional embed¬ 
ding subspaces where bifurcations in complex systems occur. With the advent of the computer 
and modern high-performance computing, these same kind of reductions can be achieved through 
principled approaches such as the proper orthogonal decomposition [38], which is also known with 
minor variation as Principal Component Analysis (PCA) [39], the Karhunen-Loeve (KL) decompo¬ 
sition, the Hotelling transform mm and/or Empirical Orthogonal Functions (EOFs) [42]. These 
methods identify the low-dimensional subspaces and modal basis that optimally represent, in an i 2 
sense, the dynamics of the system, thus forming the basis of the ROM architecture [12] . 

For our purposes, consider data that comes from a dynamical system of a single spatial variable 
x of the form 


(1) u t = N(v,x,t,u,u x ,u xx ,...), 

where TV(-) determines the evolution of the complex system which can be a function of space 
(x G [—L, L]), time (t G [0, T]) and linear and nonlinear terms involving u(x,t) and its derivatives. 
Additionally, the parameter v is a bifurcation parameter that determines the dynamical regime of 
the system. Such systems are typically solved using a numerical discretization scheme where the 
kth time point (k = 1 , 2, • • • , m) is given by 

(2) u(x,t k ) Ufc as- [u(x!,t k ) u(x 2 ,t k ) ••• u(x n ,t k )] T 

with the discretization grid Ax = Xj+i—Xj 1, x\ = — L, x n = L and n 1. Thus in a 
simulation, one has access to all the data in a discretized form in space and time. Moreover the 
data is high-dimensional since a fine grid (of size n) is typically required for accurate solutions of 
the partial differential equation. 

For various values of the bifurcation parameter v we assume we have access to the data, either 
from computation or from dense measurements in time and space. We can arrange the full data 
into a matrix whose columns are the full discretized state of the system, or snapshots, sampled 
evenly in time 

(3) A? d = [ui u 2 • • • u m ] 


where K V D G M nxm . In the application we wish to consider in this manuscript, we assume that we 
have access only to a subset of the data, based on the position in the spatial grid Xj, i.e. we have 
a limited number of spatial sensors available that are fixed to a specific spatial location. To be 
more precise, consider the the projection matrix P& whose k nonzero entries determine the spatial 
locations for data sensors (let k = 3 for illustrative purposes): 


(4) 


P3 


1 0 ••• ••• 0 

0 ... 0 1 0 ••• ••• 0 

0 ••• ••• 0 1 0 ••• 0 
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This example maps out the full state of the system onto 3 measurement locations 

(5) u = P 3 u. 

More generally for k measurement locations, we can construct the data matrix 

(6) A u s = [ui u 2 • • • u m ] 

where Ag G R fexm . Thus Ag is a subset of data generated from a small number sensors k where 
k n. Our hypothesis is that the data satisfies the following conditions: 

HI The data in A v s has a low dimensional representation in the phase space, namely, it can be ap¬ 
proximated by a low dimensional vector space while maintaining most of the energy (variance) 
in the £2 sense. 

To extract the low-rank representation of the data, we apply a singular value decomposition 
(SVD) to the data matrix to obtain 

(7) A£ = V£££U£. 

The SVD decomposition can be used for producing a principled low-dimensional representation of 
the data. Truncation is typically achieved by inspection of the diagonal singular value matrix 
Specifically, d v modes are selected that, for instance, represent 99% of the total variance in the 
data. For data with noise, recent work by Gavish and Donoho [43] provides a principled truncation 
algorithm to account for the effects of noise. 

In our analysis, we reduce the data to d v -dimensions for a variety of dynamical regimes v. This 
allows us to obtain the approximation to the data matrix 

( 8 ) Ag = 

where the barred matrices are d^-rank approximations to their unbarred counterparts, ultimately 
providing the approximation to the full data 

d u 

(9) A£«A 

i=1 

where = [v^,..., v^„], = [u^ U 2 ... u^], and are the corresponding diagonal elements 

In addition to our assumption that (Uj) exhibits low-dimensional dynamics, there is a large 
subclass of dynamical systems that also exhibit time dynamics that are nearly periodic. More 
precisely, in the application considered here, the time dynamics can be approximated by a small 
number of Fourier modes, thus allowing for a second sparsification step. This leads to the second 
hypothesis of the current work: 

H2 Each row of the matrix can be approximated, in the £2 sense, by a small number of Fourier 
modes in time, namely by cosines and sines. 
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Given this second hypothesis, our goal now is to further approximate the full data matrix 
by a sparse number of Fourier modes. Thus in the modal decomposition 0 . the matrix containing 
the time dynamic modes is approximated by 


( 10 ) 


< = £(■ 

3 = 1 


a c ^c u ■ 

U i,3 


I SM V \ 

+ a i,j S i,j) ! 


where n l - is the small (sparse) number of Fourier modes retained with 

= [cos (uijh ), cos (uijt 2 ) ,..., cos (oJijt N )] (11a) 

s ij = [sin (uJijti) , sin (w^t 2 ) , • • •, sin (w^fjv)] • (Hb) 


and where is the angular frequency obtained by the Fourier transform. 

The low-rank approximation by the SVD and the sparse Fourier mode 
can be combined to give the time-space reduction 


approximation (10) 


d v 


n,; 


( 12 ) 


As = E 


E ( 

i =1 3 = 1 


a c,u c u ■ 
a i,3 Wj 


. a s,u s u ■ 

a i,j * l ,3, 


d u 

= EEC 

i=i j =i 


CM v 

a iJ V * C iJ 


SM v \ 

a ij V ' S '-.y / 


1 CM CM j SM SM 

where ol^- = cqa^- and = a i a i ^ . 

We now perform the final dimensionality-reduction step in our analysis. Specifically, we define 
K) =«) + (cq^ ) and choose ra*' of the largest so that their sum of squares approxi¬ 
mates the energy up to a given threshold for truncation. This allows us to obtain the final low-rank 
approximation of the data matrix 


(13) 


\ ^ / CM v v 

E K 

k =1 


SM V V \ 

a k v ik s ikJ J 


Note that we do not need to store the complete vectors c-' - fe and s-f ■ , but only the vectors w v ih 


and the frequencies - fe obtained by the Fast Fourier Transform. Approximation (|T3j) allows us 


to use a small number of measurements in time and space to reconstruct an approximation to the 
entire data matrix. This is the primary innovation of this work. 


3 Reconstruction from Sparse Measurements 


The primary objective in this work is to use sparse measurements in space and time to reconstruct 
the full state u of ([l]) and ([2]). To this end, consider that we are given m v measurements 

(14) P = [Pi P2 ••• Pm"] 
at the space-time points 

(15) {t h Xi) = (TiiXi) for i = 1,2,-•• ,m l/ . 


Recall that we assumed that the measurements can be respresented sparsely by the parameter v in 
(13), namely: 


(16) 


P' = E [<]*« ( COS «,h ( T i + $) + Sin «J k ( T * + ^))) > 


k=1 
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where [v] l denotes the Z’th element of the vector, and </> is an unknown phase. 

We relax this representation by folding in the unknown phase into additional amplitude param¬ 
eters. The new representation takes the form 


(17) 


p* = £ 


„ ( A Lj k COS K,j fc T l + B l,j k sin 


k=1 


Note that for each u" ■ , there are distinct Ay H and By that do not depend on i. Thus there 

t'kijk' L kiJk L kiJk 

are a total of 2 m u amplitude parameters that need to be determined. 

The representation © is for a single measurement. The total number of measurements m u , as 
given by (14), can be represented in matrix form by 


(18) 


p = $"b, 


where the odd and even columns of are [<h"] ( 2 -_ 1 = [vfj cos(w-' j.n) and [<h"] ( 2 - = [vi j ] x sin(w^ j.Ti) 
so that 




' [V 4l 

lxi cos K,ii ri ) 

[ v il ] Xi sin(< iiji r 1 ) •• 


k sin (‘ 

(19) 

<J> /y = 

[v*i 

]x2 COS Kdi T 2) 

[vi 1 ] X2 sin« iiil r 2 ) •• 


]x2 Sin (‘ 



>il] 

XN COS (<,h T ") 

[ v n ] x w s in bi) ,j i t n) •• 

■ [Vw,] 

Xiv Sin 0 


,t n )_ 


with 


( 20 ) 


b = 


B iun 

B i2,j2 


B u 

Note that the matrix depends on the time-space locations where measurements are made. The 


reconstruction based upon (13) can then be accomplished using a standard Moore-Penrose pseudo¬ 


inverse m given the measurements p. This allows for computing the unknowns b and performing 
the full state reconstruction with limited measurements. 


4 Dynamical Libraries and Classification 

The previous section considered our ability to perform a reconstruction or approximation of the full 
state of the system using a limited number of measurements. The reconstruction was for a specific 
value of the bifurcation parameter v. However, there may be many different dynamical regimes of 
© that are of interest and have low-dimensional dynamics ED [22]. For each dynamical regime 
z/j, we can then construct the measurement matrices & Ul ,..., & UM where we assume there are M 
dynamical regimes of interest (Vi, z/ 2 , ■ • • , z'm)- We can collect these various measurement matrices 
into a single library matrix: 

(21) \l> = [§ Vl <$> U2 ... 4>^ M ]. 
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Thus \l/ contains all the low-rank approximations for space-time measurements from the M dynam¬ 
ical regimes. Such a database building strategy is also at the forefront of ROM architectures since 
ROMs are neither robust with respect to parameter changes nor cheap to generate. Thus methods 
based on a database of ROMs coupled with a suitable interpolation schemes greatly reduces the 
computational cost for aeroelastic predictions while retaining good accuracy mug. 

Our objective ultimately is to use a small number of measurements to reconstruct the full state 
of the system. However, in order to do so efficiently and effectively, one needs to classify which 
dynamical regime Uj the system is in so that the correct <$> Uj can be used for the reconstruction. 
The classification is predicated on the idea that our measurement locations (14) have the sparsest 
reconstruction (of the form (pT|)), given the correct parameter vj m m- To employ this fact 
in a classification algorithm, we shall represent the point using all the possible parameters 
/ij, generate an under determined system, and use a compressive sensing algorithm to obtain the 
sparsest representation. Our hypothesis is that the non-zero coefficients A-' - fc and B\ k - fc will be 
concentrated in the correct v. Specifically we shall construct an underdetermined linear system and 
solve it using a sparsity promoting algorithm in order to identify the correct fij . Thus classification 
is based upon optimization whereas reconstruction relies on an £2 projection unto the correctly 
identified basis. 

To be more precise, our classification is based on the following minimization problem 


(22) minHaljj s.t. p = Ta 

where the unknown vector a determines the weighting of the library elements T' unto the measure¬ 
ment p. The £1 minimization is a sparsity promoting algorithm that attempts to give a solution 
a that has as many zeros as possible. The non-zero components are used as an indicator for the 
dynamical regime and modes, Vj and respectively. Here, however, the classification exploits 
both time and space measurements, whereas previous work mma only considered measurements 
at a single fixed time for classification. 

Classification can be accomplished by considering a relaxed form of the minimization by a 
LASSO algorithm [46j 

(23) minHalh s.t. ||p - 'tfa || 2 < 5, 

for some parameter S. This minimization problem minimizes the error, in an £2 sense, between the 
measurements and the projection on to the library with the sparsest vector a. The sparse solution 
a can then be used to determine the dynamical regime Vj the system is in. Once determined, 
reconstruction can be achieved via Specifically, the classification of the dynamical regime is 

done by summing the absolute value of the coefficients of a that corresponds to each dynamical 
regime Vj . To account for regimes with a larger number of coefficients allocated for their dynamical 
regime, we normalize by dividing by the square root of the number of POD modes allocated in a 
for each fij. The classified regime /ij is the one that has the largest magnitude after execution of 
this algorithm. 


5 Application: Flow Around a Cylinder 

We demonstrate the sparse time-space sampling algorithm developed on a canonical problem of 
applied mathematics: the flow around a cylinder. This problem is well understood and has already 
been the subject of studies concerning sparse spatial measurements EU H3 ED EH]. Specifically, it 
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Figure 1: Stream lines and pressure field near the cylinder for a typical snapshot taken for Reynolds 
numbers (a) v = 40, (b) v = 150, (c) v = 300, and (d) v = 1000. 


is know that for low to moderate Reynolds numbers, the dynamics is spatially low-dimensional and 
POD approaches have been successful in quantifying the dynamics Additionally, 

the time dynamics is nearly periodic, thus suggesting that the asynchronous sampling in time 
advocated here can be exploited for this problem. The Reynolds number plays the role of the 
bifurcation parameter v in §• 

The data we consider comes from numerical simulations of the incompressible Navier-Stokes 
equation: 

c)u 

— + u • Vrz + Vp — z ;\7 2 u = 0 (24a) 

V • u = 0 (24b) 

where u(x,y,t) E R 2 represents the 2D velocity, and p(x,y,t) E R 2 the corresponding pressure 
field. The boundary condition are as follows: (i) Constant flow of u = (1,0) T at x = —15, i.e., the 
entry of the channel, (ii) Constant pressure of p = 0 at x = 25, i.e., the end of the channel, and 
(iii) Neumann boundary conditions, i.e. = 0 on the boundary of the channel and the cylinder 
(centered at (x,y) = (0,0 and of radius unity). 


5.1 The Data: Snapshots of Fluid Pressure 


Our data comes from numerical simulation of the incompressible Navier-Stokes equation (24), com¬ 
puted using the Nektar++ package [53] > which produces accurate results using a high-order finite 
element method. The algorithm uses a non-uniform mesh consisting of 228 grid-points, with the 
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Figure 2: Time evolution of the pressure field around the cylinder for increasing Reynolds numbers 
v = 40 (T = 8), v = 150 (T = 8),u = 300 (T = 20), and v = 1000 (T = 20). 


high-order method producing 66,000 Gaussian quadrature points, i.e. the numerical discretization 
yields an n = 66,000 dimensional system. Figure [l] shows typical snapshots of the streamlines 
and pressure profiles taken once the system transients have died away and the flow has reached 
equilibrium or a time-periodic state for various Reynolds numbers. 

The different dynamical regimes of (24) correspond to different Reynolds number flow. Thus 
the classification and reconstruction problem we consider involves library elements extracted from 
the flow at Reynolds numbers v = 40,150, 300, 800,1000. Specifically, our measurements are based 
on the pressure field at the perimeter of the cylinder where sensors could be easily placed. In 
particular, a sparse number of such sensors are used to classify (identify) the Reynolds number and 
reconstruct the pressure field around the cylinder and in the fluid flow. Note that placing sensors 
in the fluid flow itself may be valid for lab experiments and computer simulations. However no 
realistic system of interest, such as an airfoil or insect wing, places sensors directly in the flow field 
behind the structure. Thus there is a clear reliance on limited measurements on the cylinder itself. 

The time evolution of the pressure field on the perimeter of the cylinder is shown in Figure [2] for 
several Reynolds numbers. As can be seen, increasing the Reynolds number drives the dynamics 
from a steady-state configuration to a time-periodic evolution. The waterfall plots of the pressure 
dynamics on the cylinder are essentially the snapshots used for projecting the dynamics onto a 
low-dimensional manifold through the SVD, i.e. the snapshots provide the data necessary for the 
low-rank, POD methodology '38] . 

For each relevant value of the parameter v we perform an SVD on the data matrix in order to 
apply the dimensionality reduction method described in Sec. [2] It is well known that for relatively 
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• cylinder 




Figure 3: Normalized decay of singular values (top left) of the data matrix for various Reynolds 
number ^ = 40,150,300,1000 (top right on logarithmic scale). As the Reynolds number increases, 
a higher dimensional space is needed to preserve the same amount of energy. The dominant three 
pressure modes are shown in polar coordinates. The pressure scale is in magenta (bottom left). 


low Reynolds number, a fast decay of the singular values is observed. This can be seen in Fig.[3]along 
with the 3 most dominant POD modes. Thus for every Reynolds number = 40,150, 300, 800,1000, 
we apply the procedures described in Sec. 2 and 3 on the data matrix A" in order to compute the 
quantities and CoT j k . 


5.2 Sparse Representation 

For every Reynolds number we keep 99% of the total energy (variance) which gives for the Reynolds 
numbers v — 40,150,300,800,1000 considered a total of 1,3, 3, 9, 9 POD modes to represent the 
dynamics. More precisely, it determines the number of non-zero coefficients (1,3,3,9,9) in the 
sparse approximation (13) (i.e. non zero o^’s and a s k ,u ’ s). The specific modes chosen by our 
representation, based on the singular value analysis, namely on the magnitude of {o ^-) 2 = (cq’J) 2 + 
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Table 1: Sparse Representation: The table contains the top 3 coefficients in the expansion (13) 

\2 / , / a _ i /\2 


where we specify (aJL) = (cq’J ) + ( a ij) 


Reynolds 

Number 

# Modes 

Top 3 Coefficients 

o 

II 

1 

«1 U 0 = 1 



V = 150 

3 

a}f 0 u = 0.97 

a 2 5 T=170 — 0.03 


v = 300 

3 

a? u 0 u = 0.92 

a 2?T=375 = 0.07 


v = 800 

9 

a» U o> = 0.87 

<T= 3 43 = O.H 

a 3 U T=172 — 0-04 

v = 1000 

9 

a{ u 0 uu = 0.85 

«2T=333 = 0-12 

a 3°T=166 = 0.06 


Table 2: The error rate of our algorithm with noise that is normally distributed with the standard 
deviation increasing across the columns. It can be seen that for low to no additive error choosing a 
small parameter 5 for the Lasso [23] provides a good performance, while once the error is increased 
then the algorithm fails, and provides result that are not any better than guessing. Note that 
increasing the Lasso parameter S provides improved performance for higher error, while decreasing 
the performance for low or no error. 


Error (std) 

0 

‘2r‘ 

2 -5 

2 -4 

II 

o 

1— 1 

0.89 

0.88 

0.2 

0.2 

5 = 0.7 

0.8 

0.82 

0.83 

0.82 


( a ij) 2 f° un d in Table [lj 

5.3 Results 

We applied the sparse classification algorithm in Sec. 4 to the training data collected in the previous 
subsection. Based on previous results |21| . we have chosen the sparse measurements at positions 
corresponding to maxima and minima points of the dominant spatial modes (the vj'). Specifically 
20 such position where chosen. The classification algorithm was applied to 100 measurements 
randomly selected over the time interval of training. Namely, classification was based on 2.5% of 
the data. The results of classification subject to noise with a random distribution is presented in 
Table [2j 

It should be noted once again that the method demonstrated here extends previous work mm 
by considering the full spatio-temporal dynamics. Specifically, previous findings were associated 
with successfully classifying and reconstructing a single snapshot in time. Here, the much more 
difficult task is considered of reconstruction the entire spatio-temporal behavior with limited mea¬ 
surements. The results presented show the method is quite effective in this task, thus providing a 
potentially transformational paradigm for taking advantage of limited measurements of a complex, 
spatio-temporal system. 


11 




























Figure 4: The figure above shows the temporal-spatial modes. These modes corresponds to the 
specified Reynolds number, and the mode number corresponds to the magnitude of the energy of 
the specific mode. 

6 Conclusion and Outlook 

Modern data methods and analysis techniques look to exploit underlying low-dimensional structures 
in complex data sets. In the case of time-dependent data generated from complex systems, effective 
methods must capitalize simultaneously on the underlying low-rank structures in both time and 
space. In doing so, we have demonstrated that one can use a sparse number of spatial sensors 
that sample randomly (asynchronously) in time to accurately classify the dynamical state of the 
system even in the presence of noise. The method advocated integrates two transformative tools of 
analysis: (i) model reduction (machine learning) methods for complex systems and (ii) compressive 
sensing/sparse representation 

The current mathematical architecture and innovation extends previous work on sparse sampling 
of complex systems by exploiting the nearly periodic time behavior known to be exhibited by many 
complex systems, including the flow around a cylinder example considered here. Indeed, taking 
advantage of the sparse signal representation in time allows for better classification of the dynamical 
state. Moreover it equally, and maximally, exploits the low-dimensional behavior in both time and 
space. Previous analysis relied on a single measurement in time for performing such classification 
tasks, thus only exploiting the low-dimensional spatial structures. 

The combination of dimensionality reduction and sparsity promoting techniques advocated here 
can be applied in an exceptionally broad context. Indeed, such algorithmic strategies can be 
used to enhance computation and efficiently identify measurement locations in a given system by 
remembering the system’s key characteristics in both time and space. The low-rank spatio-temporal 
nature of the approximations used allows construction of control algorithms that wrap around the 
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dimensionality reduction and sparsity infrastructure—another appealing aspect of the methodology. 
In conclusion, we advocate a general theoretical framework for complex systems whereby low-rank, 
spatio-temporal libraries representing the optimal modal basis in time and space are constructed, 
or learned, from snapshot sampling of the dynamics. 
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